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[57] ABSTRACT 

Objects or files are created containing problem source 
identification information. The database of problem source 
identification methods is provided to the user through a 
computer user interface with statistical ranking according to 
the problem symptom provided by the user. The user pro- 
vides to the system relevance feedback for the particular 
problem source identification method, appending the symp- 
tom to the method, marking the method for review update 
and/or deletion. A simple method is provided for searching 
the solution database once the cause has been identified. 
Problem source identification methods of the most use 
and/or most common frequency of occurrence are ranked 
accordingly, obviating the problem of creating and main- 
taining cases associated with case-based systems. In addi- 
tion to the database of problem source identification (PSI) 
methods for a particular problem domain and a database of 
solutions to problems in such domains, a search engine order 
search hits based on statistical ranking. Each PSI method 
contains hyperlinks into the solution database to create a 
network of methods and solutions. 

27 Claims, 7 Drawing Sheets 
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SYSTEM AND METHOD FOR IMPROVING 
PROBLEM SOURCE IDENTIFICATION IN 
COMPUTER SYSTEMS EMPLOYING 
RELEVANCE FEEDBACK AND STATISTICAL 
SOURCE RANKING 

This is a continuation of application Ser. No. 08/555,951 
filed Nov. 13. 1995. now abandoned. 

TECHNICAL FIELD 

This invention relates in general to computer processing, 
and more particularly, to automated systems and methods for 
assisting in the identification of sources of problems in 
complex computer systems and the like. 

BACKGROUND OF THE INVENTION 

One area where application of computer systems is par- 
ticularly beneficial is in their use as tools to solve problem 
in diverse disciplines ranging from medical diagnostics to 
computer system service and support Given the increasing 
complexity of such systems in need of problem-solving 
tools, there is a correspondingly increasing variety and 
sophistication of such tools being made available. 

For example, with the advent of various online systems 
and services, mere has been immense improvement in 
delivery mechanisms and diagnostics for computer systems 
themselves. A technician at a remote location may be able to 
examine a local computer installation from a remote 
location, diagnose a problem, and even provide bug fixes 
and the like over a network without the user even having to 
interact with the problem-solving technician. 

Notwithstanding such advances, the immense problem of 
facilitating better diagnostics and problem solving neverthe- 
less still remains. Extensive development has gone into 
better utilizing the improved memory capacity and process- 
ing capability of modern computers for such diagnostics and 
problem solving. Accordingly, developments in the field of 
expert systems and artificial intelligence, for example, have 
been brought to bear in an effort to provide users of 
computer systems with simpler and more effective methods 
of solving problems with the systems. 

The fundamental approach to computer-aided problem 
solving relies upon case or rule-based system design. In the 
design of such systems, expert knowledge and systems, and 
various forms of an inference engines are utilized to assist 
the user in determining the solution to a problem. In essence, 
such systems attempt to synthesize the expert knowledge 
and store it in the inference engine. This is a tremendously 
advantageous and powerful approach provided the expert 
knowledge is easily obtainable and maintainable and may be 
readily synthesized into such an inference engine. However, 
it is precisely for these reasons that these prior art 
approaches do not necessarily work in all applications, and 
in particular in situations involving large and constantly 
changing problem domains. 

Representative references disclosing various approaches 
to inference engines and inference expert systems may be 
found in U.S. Pat No. 5.243.689; U.S. Pat No. 5,195.029; 
U.S. Pat No. 5,182,793; and U.S. Pat No. 5,224.206. 

Such case-based systems have several unique character- 
istics which unfortunately also carry with them several 
drawbacks. First, case-based systems attempt to "solve" a 
problem, focusing on this rather than assisting in merely 
identifying what the problem is. Case-based systems typi- 
cally imbed the symptom, cause, and solution of problems 
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into their cases, a representative example of which may be 
found in the aforementioned U.S. Pat. No. 5.224.206. col. 
12. This case database approach suffers from several dra- 
matic disadvantages associated with large and constantly 

s changing problem domains. 

First the knowledge necessary to create such a database 
simply may not exist For example, new products may have 
to be encompassed by the system with never-before seen 
problems, or the problems may relate to the network envi- 

10 ronment with a correlative huge number of permutations and 
combinations of causes. 

Secondly, creating these cases by gathering the facts and 
synthesizing them can be an extremely expensive and time 
consuming proposition — so much so that many projects 

15 embarking on problem solution employing this method fail 
at this point once the system designer appreciates the 
magnitude of the case creation task itself. 
Thirdly, in a rapidly changing problem domain, even if it 

20 is acceptable system design to incur the cost of creating the 
cases, such case information nevertheless is always subject 
to being incomplete or obsolete and in need of expensive 
maintenance. 

Thus, in summary and by way of background, many types 

25 of expert system designs exist for solving problems and have 
become quite sophisticated. However, as aforesaid they rely 
on case-based or rule-based engines (although a few neural 
network systems exist as well). Such expert systems involve 
extensive knowledge engineering, which is to say they incur 

30 significant cost in creating extensive rules or large numbers 
of cases necessary to address (he problem domain. Thus, 
these systems fail to provide an adequate solution for large 
problem domains such as for example in commercial soft- 
ware defect support for operating systems. Li the latter 

35 application, for example, the knowledge base is so extensive 
and there always appears to be so much more to be learned 
about the problem domain that creation of an adequate 
knowledge model appears to be an unattainable goal, 
although a necessary ingredient for state of the art systems. 

40 Such domains are continuously and rapidly changing such 
that the expert system model approach collapses when 
confronted with the scope of such knowledge and the large 
number of permutations of real-life service issues. 

45 SUMMARY OF THE INVENTION 

It is therefore one object of the present invention to 
provide an improved system and method for automated 
problem source identification in computer systems. 

It is another object of the present invention to provide an 
50 improved problem source identification system and method 
having characteristics of expert systems while at the same 
time avoiding the associated expense. 

It is a further object of the invention to provide for an 
55 improved problem source identification system and method 
which obviates the need to store cases and rules and to 
provide inference engines. 

It is still a further object of the invention to provide a 
system and method for automated problem source identifi- 
cation more readily adaptable to large problem domains. 

It is yet another object of the invention to provide an 
improved system and method for delivering software defect 
support in a cost effective manner, taking advantage of 
assumptions of skilled technical users. 
65 In accordance with the teachings of the invention, a 
system and method is provided which improves problem 
resolution time and quality by capturing problem source 
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identification methods, storing these methods in a searchable 
database, and then modifying the retrieval and sorting of 
these methods employing a relevance feedback mechanism. 
Results from such problem source identification systems and 
methods are thereafter utilized advantageously to hyperlink 
to specific information explaining how to resolve the prob- 
lem. 

In accordance with the invention, the system and method 
disclosed herein simplifies the creation and administration of 
providing computer-based problem identification and solu- 
tion assistance. In a preferred implementation of the model, 
objects or files are first created containing problem source 
identification information, such information typically being 
readily available in commercial enterprises but simply not in 
a database form. Next the database of problem source 
identification methods is provided to the user by means of an 
appropriate user interface on a computer network with a 
statistical ranking according to the problem symptom pro- 
vided by the user. The user with the problem in need of 
solution then provides to the system relevance feedback for 
the particular problem source identification method, append- 
ing the symptom to the method, marking the method for 
review, update, deletion, and the like. A simple method is 
provided to search the solution database once the cause has 
been identified. The foregoing system and method thereby 
causes problem source identification methods of the most 
use and/or most common frequency of occurrence to be 
ranked accordingly, thereby obviating the problems associ- 
ated with creating and maintaining cases in case-based 
systems. 

In the preferred embodiment, an assumption of a techni- 
cally skilled user is made. Such user's whose analytical 
skills are combined with the storage and statistical capabili- 
ties of the computer to provide a powerful but simple 
approach to solving the problem addressed by the invention. 
A significant object of the invention is that the fundamental 
problem is actually separated into two distinct components 
of problem source identification and problem solution. 

In addition to the database of problem source identifica- 
tion (PSI) methods for a particular problem domain and a 
database of solutions to problems in that domain, the afore- 
said search engine preferably may order search hits based on 
statistical ranking or semantic distance ranking. Each PSI 
method preferably contains one or more hyperlinks into the 
solution database in order to create a network of methods 
and solutions. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the invention 
are set forth in the appended claims. The invention itself, 
however, as well as a preferred mode of use, further objects 
and advantages thereof, will best be understood by reference 
to the following detailed description of an illustrative 
embodiment when read in conjunction with the accompa- 
nying figures wherein: 

FIG. 1 is a pictorial representation of a computer system 
including local area networks in which the system and 
method of the present invention may be advantageously 
implemented. 

FIGS. 2A and 2B depict block diagram representations of 
representative ones of the computers shown in FIG. 1 from 
which the user may provide and obtain problem solution 
input and output, respectively, in the manner of the inven- 
tion. 

FIG. 3 is an illustration of a typical graphical user 
interface which may be provided to the end user for input/ 
output 
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FIG. 4 is a conceptual illustration of the statistical data- 
base search in accordance with the invention illustrating the 
relevance feedback mechanism 

FIG. 5 is a pictorial representation of a hierarchical 
5 diagnostic network including hyperlinks employed in the 
implementation of the invention. 

FIG. 6 is a pictorial representation of a database build 
with relevance feedback utilized in a preferred embodiment 
of the invention. 
10 FIG. 7 is a flow diagram illustrating the flow of a software 
system in accordance with the invention implementable on 
the system of FIG. 1 for effecting problem source identifi- 
cation. 

15 DETAILED DESCRIPTION OF THE 

PREFERRED EMBODIMENT 

In order to understand application of the invention to 
computer networks, a description will first be provided of a 

20 representative such computer network wherein the invention 
may be advantageously employed. It will be readily appre- 
ciated that the invention admits to applicability to any 
embodiment of a computer network and thus is not intended 
to be so limited to the particular illustrative network here- 

25 inafter described. 

With reference now to the figures, and in particular with 
reference to FIG. 1, there is depicted a pictorial represen- 
tation of a data processing system 8 which may be utilized 
to implement a method and system of the present invention. 

30 As may be seen, data processing system 8 may include a 
plurality of networks, such as local area networks (LAN) 10 
and 32. each of which preferably includes a plurality of 
individual computers 12. 12a-12c, 30. 31. 33 and 35. 
(Hereafter, when discussing a computer in network 32. a 

3 5 computer 30 will be arbitrarily referenced, although the 
discussion could relate to any of the computers in network 
32). Computers 12 and 30 may be implemented utilizing any 
suitable computer such as the IBM Personal System/2 (also 
called a 'TS/2") computer or an IBM RISC SYSTEM/6000 

40 computer, both product of International Business Machines 
corporation, located in Armonk. N.Y. "RISC SYSTEM/ 
6000". is a trademark of International Business Machines 
Corporation, 'Personal System/2" and "PS/2" are registered 
trademarks of International Business Machines Corporation. 

45 Of course, those skilled in the art will appreciate that a 
plurality of intelligent work stations (IWS) coupled to a host 
processor may be utilized for each such network. 

As is common in such data processing systems, each 
individual computer may be coupled to a storage device 14 

50 and/or a printer/output device 16. One or more such storage 
devices 14 may be utilized, in accordance with the method 
of the present invention, to store objects, such as documents, 
resource objects, or executable code, which may be peri- 
odically accessed by any user within data processing system 

55 8. In a manner well known in the prior art each such object 
stored within a storage device 14 may be freely interchanged 
throughout data processing system 8 by transferring an 
object to a user at an individual computer 12 or 30. for 
example. 

60 Still referring to FIG. 1* it may be seen that data process- 
ing system 8 also may include multiple mainframe 
computers, such as mainframe computer 18. which may be 
preferably coupled to LAN 10 by means of communications 
link 22. Mainframe computer 18 may be implemented 

65 utilizing an Enterprise Systems Architecture/370 (also called 
an "ES A/370") or an Enterprise Systems Architecture/390 
(also called an "ESA/390**) computer available from IBM. 
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Depending on the application a midrange computer, such as 
an Application System/400 (also called an "AS/400"), may 
be employed. "Enterprise Systems Architecture/370 M , 
"ES A/370". "Enterprise Systems Architecture/370", and 
"ES A/390" are trademarks of IBM; "Application System 
/400" and "AS/400" are registered trademarks of IBM; 
"Application System/400" and "AS/400" are registered 
trademarks of IBM. Mainframe computer 18 also may be 
coupled to a storage device 20 which may serve as remote 
storage for LAN 10. Similarly. LAN 10 may be coupled via 
communications link 24 through a subsystem control unit/ 
communications controller 26 and communications link 54 
to a gateway server 28. Gateway server 28 is preferably an 
individual computer or IWS which serves to link LAN 32 to 
LAN 10. 

As discussed above with respect to LAN 32 and LAN 10, 
objects may be stored within storage device 20 and con- 
trolled by mainframe computer 18, as Resource Manager or 
File System Manager for the stored objects. Of course, those 
skilled in the art will appreciate that mainframe computer 18 
may be located a great geographic distance from LAN 10 
and similarly LAN 10 may be located a substantial distance 
from LAN 32. For example. LAN 32 may be located in 
California while LAN 10 may be located within Texas and 
mainframe computer 18 may be located in New York. 

A preferred embodiment of the present invention may be 
incorporated within various computers depicted within data 
processing system 8. Referring now to FIG. 2A. a block 
diagram of LAN 10 is depicted for implementing a method 
and system of the present invention. Server 12 communi- 
cates with computer 12a~l2c over communications channel 
34. LAN 10 is depicted in a token ring geometry, however, 
other geometries are possible. Server 12 may be a conven- 
tional computer, such as an IBM PS/2 or AS/400 system 
programmed to practice this invention. Server 12 includes a 
central processing unit (CPU) 35, a memory 38, and a 
network adapter 40. Network adapter 40 is utilized for 
formatting outgoing transmissions and for deformatting 
incoming transmissions. Server 12 also includes a hard drive 
unit 42 for storing various objects, such as data files or 
executable code. Objects may be accessed by one or more 
users, wherein an object may be transferred to computer 
memory 38 over data bus 44. A number of objects may exist 
within memory 38. An operating system and local are 
network server 46 are represented as one object within 
memory 38. 

Various users may access objects by sending a request to 
a file system which is conventionally resident on hard drive 
42 in server 12 utilizing computers 12a-12c. A "file system" 
is a collection of files and file management structures that 
may be located on the physical or logical mass storage 
device (or even memory 38). Computer 12b is a typical 
example. Computer 126 operates as a personal work station 
communicating with server 12. Schematically, computer 
12b is substantially similar to server 12. and includes a 
network adapter 60. a display adapter 62. a hard drive unit 
64. a central processing unit (CPU) 66. and addressable 
memory 68. Components of computer 126 transfer data over 
data bus 70. CPU 66 directly controls input peripherals 72, 
which may include a keyboard and a mouse. Display adapter 
62 drives display device 74. Memory 68 includes part or all 
of an operating system 73 which also is conventionally 
resident in the mass storage device such as hard drive 64. 
Memory 68 also includes object 76. which was supplied by 
computer 12 in response to a request to computer 12. 

Referring now to FIG. 2B, a block diagram of mainframe 
computer 18 is depicted in accordance with a preferred 
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embodiment of the present invention. Mainframe computer 
18 is a single computer system running multiple processes, 
such as an IBM ES A/370 or ESA/390 attached to multiple 
nonprogrammable work stations (NWS) lOOa-lOOw. Main- 

5 frame computer 18 includes a hard drive unit 102, CPU 104. 
input/output (I/O) processor 106 for communicating with 
nonprogrammable work stations 100a-100/i, network 
adapter 108. and memory 110. Hard drive unit 102 may store 
objects. Each nonprogrammable work station may access an 

10 object within memory 110 or hard drive unit 102. For 
example, nonprogrammable work station 100a would access 
object 112a, nonprogrammable work station 1006 would 
access object 1126. and nonprogrammable work station 
lOOn would access object 112n in accordance with a pre- 

15 ferred embodiment of the present invention. 

First an overall description of the invention will be 
provided followed by a more detailed description with 
reference to the figures. 
It will be noted that, as described, the invention places 

20 emphasis on collecting and maintaining problem source 
identification methods. However, in distinct contrast to 
methods of the prior art these problem source identification 
methods are not linked to cases and are not built by rules into 
an expert system, but rather are created by problem domain 

23 experts and retrieved by users employing a statistical or 
semantic distance search algorithm. The ranking of the 
problem source identification (PSI) methods are "skewed", 
i.e.. the order in which the PSI methods are ranked are 
modified by the relevance feedback mechanism to be 

3Q described in greater detail 

The relevance feedback mechanism, in one embodiment, 
consists of the user pressing a button that informs the 
application that a particular PSI method has provided helpful 
diagnostic information. It is important to note that the 

3 5 system of the invention may not have actually solved the 
problem, but importantly may have eliminated a number of 
other possibilities. The search query, which is the symptom 
string the user employed to locate the successful problem- 
solving method, is then attached to the original method. 

40 These additional words may skew this PSI method more 
towards this particular symptom string, thereby causing this 
method to appear higher in the list of appropriate methods on 
subsequent queries. Bach of these PSI methods may contain 
one or more hyperlinks to other PSI methods or specific 

45 problems/solution records, thereby creating a network of 
methods and solutions. The PSI methods that are ranked and 
returned for a query typically in accordance with the inven- 
tion will be found to improve over time due to the relevance 
feedback mechanism. The development, improvement, and 

so reuse of the PSI Methods thereby will improve the diagnos- 
tic skills of the user and increase the accuracy and consis- 
tency of the provided diagnostic service. 

From the foregoing it will be apparent that several sig- 
nificant features are provided in the invention. First, the 

55 invention emphasizes and teaches problem source identifi- 
cation skills rather than problem rediscovery. Secondly, as 
will become more readily apparent, the invention employs a 
semantic distance search algorithm to retrieve relevant 
methods as opposed to the case or rule based expert systems 

60 prevalent in the prior art. Thirdly, the user search query is 
employed to provide relevance feedback which improves the 
network over time as previously noted. Furthermore, by 
employing such semantic distance search technology, the 
need is eliminated for the expensive creation and mainte- 

6s nance of complicated cases or rules. 

It will be readily apparent that the invention is not 
intended to be limited in any way to application only to 
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software defect support Rather, it readily admits to appli- diagnostic window 302. It will be noted that the series of 

cability in essentially any problem source identification diagnostic methods listed in window 302 have a hierarchical 

environment wherein the problem domain knowledge base arrangement wherein the methods listed at the top of the list 

is either large, constantly changing, or insufficiently well have a higher degree of probability of being successful 

understood enough to create a comprehensive or case-based 5 (based upon user experience feedback) than those methods 

system. It is a significant advantage that the invention does appearing lower in the list, 

not attempt to solve the problem. In contrast, conventional 0i . I4 , . A „ ' . a . ^ . 

expert systems in fact do attempt to go directly from A S f to HCi 3. if me user desires, further more 

symptom to solution. However the design of the invention dcUuAcd mformatlon about a & ycn i**"* appearing in the 

assumes there is insufficient knowledge in the database to tn ^osUc method window 302 may be found such as that 

solve the pdUem.Acco«^ 10 shown in the PSI method view window 306. The text 

situations wherein there are large, poorly understood prob- a PI**™g in w ^ w » * m0K description of 

lem domains which are constantly changing. It is a feature toe corresponding PSI method appearing in the diagnostic 

of the invention to address this problem by focusing on ™* hc ? ^ ndow 302 selected bv me user - As will be 

identifying the best problem source identification technique „ *»ajed in greater detail hereinafter, the relevance feed- 

rather than solving the problem per se. By putting focus on back from me users of ^ I* 0 *"* a sk£W which 

problem source identification rather than rediscovery of the causes me method #1 (corresponding to method view 306) 

problem, the complex distributed heterogeneous world of t0 ^ l on mc Agnostic method window 302. 

computing may be simplified into well understood problem 1° a typical embodiment the contents of the method view 

source identification techniques. window 306 would consist of text on how to debug the 

By using these PSI techniques, a "service" analyst 20 symptom represented by the user search argument 301 from 

(whether it be for software defect support or medical mc scarcn window 300. Additionally, however, it may also 

diagnosis, etc.) can decrease the size of the problem domain desirably further consist of "how to** types of information 

much in the same way a computer uses a binary search such ***** in the "how to" window 308. This may 

algorithm. In addition, it is a feature of the invention to 25 ^ textual information describing to the user how to 

capitalize on the fact that there is a much smaller set of PSI configure, install, or analyze performance of the system, 

techniques and mat they would not change as much over subsystems, components, or the like, 

time as rules or cases. Yet an additional although somewhat Also shown in FIG. 3 is a defect abstract window 304. 

intangible but significant advantage to the teachings of the This may be recognized as a more conventional short 

invention is that it implicitly provides additional training ^ descriptive list of defects which may also be located by the 

received by the service analyst Rather than learning redis- database search in response to the argument 301. For each 

covery skills which quickly become useless or obsolete as such possible specific shortened description of defects, pref- 

the product line rapidly changes, the service analyst employ- erably a corresponding defect view 310 window will be 

ing the invention learns problem source identification skills provided, amplifying on each such defect 

which often transcend product and brand boundaries. 35 Again, as with the diagnostic methods 302. preferably the 

Expert systems continue to be a growing market even database search engine and statistics will prioritize the listed 

though more and more companies have been discouraged by defects such that ones appearing at the top of the list are 

the disparity between the costs to develop an expert system more likely to be specific problem solutions to the problem 

and the return on investment For many large companies, the set forth in the argument 301. Hie text in the defect view 

rule or case-based systems have proven to be too costly to 40 window 310 corresponding to a particular defect will be 

build and much too costly to maintain as well. The invention recognized as the traditional defect information returned by 

greatly simplifies the whole model and paradigm. most prior art Rediscovery" types of problem-solving data- 

With the foregoing high level view of the invention bases, 

having thus been provided, attention is now directed to FIG. Turning now to FIG. 4. a conceptual high level illustration 

1, which shows a block diagram of a plurality of computers, 45 of the invention may be seen mere. The invention provides 

workstations, or the like, which may be employed in a for a statistical database comprised of problem solution 

network such as that shown wherein the invention may be methods 402 as well as the more conventional collection of 

advantageously implemented. defect information 406. An important aspect of FIG. 4, 

Turning now to FIG. 3. mere is depicted a representative however, is the appearance of the relevance feedback 

collection of typical windows encountered in an implemen- so mechanism 404 tied into the problem source identification 

tation of the invention on a display screen of one of the methods 402 which will be described in greater detail later, 

computers of FIG. 1. In use, a user faced with a problem first Suffice is to say for the present mat this relevance feedback 

formulates a search strategy and a search text argument 301 404 represents a history of user interaction with the system 

in the search window 300, articulating as best he or she can, so as to provide a statistical basis for ranking the PSI 

what the problem is. The invention admits to many differing 55 methods which will appear in a diagnostic window 302. The 

types of search options 303 for carrying this out well known database build details and results of the database build will 

in the art such as Boolean searches, specifying proximity of be described hereinafter in greater detail, 

key words, and the like. The system then takes the argument Referring now to FIG. 5. before going into greater detail 

301 and runs it against a database with a statistical database regarding the relevance feedback aspect of the invention, it 

search (both of which will be hereinafter described in greater 60 will first be noted that the invention admits to multiple 

detail), the result of which is a problem source identification methods for searching the diagnostic network such as that 

(PSI) diagnostic method window 302. having as its contents shown in FIG. 5. A statistical search into such a network of 

various suggested diagnostic methods to be carried resulting the diagnostic methods provides an easy mechanism to 

from the clues given by the search argument 301. One bypassing elementary diagnostic steps and attempting to 

example diagnostic method for addressing faults in a com- 65 immediately pinpoint critical steps. Providing for the diag- 

puter network might be. for example, requesting the user to nostics methods in a hierarchical diagnostic network such as 

ping the remote host (shown as diagnostic method #4 in that shown in FIG. 5 further allows for easy step by step 
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development and browsing which provides the ability to 
create an elaborate network of documents with hyperlinks 
providing correlation between methods. 

Whereas the relevance feedback mechanism to be 
described provides a dynamic method of creating and 
weighing new and current relationships between methods, 
yet another view of related PSI methods in the problem 
domain is sometimes useful as shown by the hierarchical 
network of FIG. 5 wherein hyperlinks provide a static 
method of viewing the related methods in the problem 
domain. In a practical implementation of such a system 
providing for hyperlinks, a PSI method homepage 508 may 
be provided with an elaborate network of documents 
510-516 containing information about the related PSI meth- 
ods. It is important to note that by providing hyperlinks such 
as link 518 between these documents, this static method of 
viewing such related methods may thereby be provided. 
Thus, in summary, two views of the related PSI methods 
may be provided for — a static method involving hyperlinks 
518. and the relevance feedback method to be described now 
which provides a dynamic method of creating and weighting 
the new and current relationships. 

Turning now to FIG. 6. additional detail will be provided 
detailing how. in a preferred embodiment, relevance feed- 
back may be effected by the system of the invention and how 
the database build may transpire with such relevance feed- 
back. Shown in the figure is a conceptual block diagram 
representing various components of the system. More 
particularly, diagnostic method block 600 is intended to 
represent the various PSI methods collected in the system. 
Additionally, data gathered from the user on the relevance of 
such methods to solving the problems is shown conceptually 
by the relevance feedback block 602. 

After the system is in use. statistical indexes 604 will be 
generated from the users in correlating the methods 600 by 
means of the relevance feedback 602. These indexes 604 
will then be utilized in subsequent access to the database 
606. For each such diagnostic method (listed as diagnostic 
methods 302 in FIG. 3) and shown collectively as diagnostic 
methods 600. the relevance feedback 602 will be combined 
with it to provide statistical analysis. However, only a 
pointer to the file system referenced to the diagnostic 
method(s) 600 will be provided in the database 606. It will 
be noted that the diagnostic methods 600 preferably will be 
pre-sorted into key types or corpuses (e.g.* problem 
domains). It will further be appreciated that the relevance 
feedback file 602, in effect skews statistical indexing 604, 
however, it is not placed into the database 606. Le., is not 
generally available to the user. 

Focusing more particularly on the relevance feedback 
function 602. it will be readily appreciated that there are 
many ways to provide such relevance feedback. One 
practical, effective implementation is to provide a user 
activated feedback button on the user interface of FIG. 3 
which, in response to input from the user, communicates to 
the PSI method application that the particular diagnostic 
method 600 employed by the user was helpful. This, in turn, 
causes the application to append the search text (reference 
numeral 302. FIG. 3) to the relevance feedback 602 (FIG. 6) 
for that particular diagnostic method 600. 

When the search database of FIG. 6 is rebuilt periodically, 
the relevant feedback file 602 will be appended to the 
diagnostic method file 600 for statistical analysis in order to 
arrive at the statistical indexes. 604. This causes the diag- 
nostic method* s statistical footprint to be skewed in the 
indexes 604 in favor of the relevance feedback 602. 
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As a result of this periodic database 606 build, a normal 
build of defects (406. FIG. 4) will of course transpire. 
However, it is significant that an additional build of diag- 
nostic methods 600 further occurs which is weighted by the 
5 relevance feedback 604. Key types for corpuses may have 
been defined for discrete problem domains. It is important to 
note that after such database build, searches may now be 
performed on the database 606 per FIG. 3. which will return 
defect (304) and diagnostic (302) abstracts. The defect 

10 abstracts. 304 would normally point to objects which have 
been stored in the database 606. (As an aside, compression 
technology well known in the art may advantageously be 
employed to save disk space, as normally one would not 
desire to edit these objects directly.) The diagnostic method 

is abstracts. 302, would normally point to objects or files 
which exist in a file system, making it easy to edit and 
browse directly from the file system. Example files include 
the PSI method view files 306 and the "how to" files 308. 
At this point it may be helpful to provide an example of 

20 three cases of searching employing the relevance feedback 
steps of the invention wherein a user, as a result of the 
search, will have produced by the invention diagnostic 
methods 302 and defect abstracts 304 per FIG. 3. 
In the first case, the diagnostic method abstract 302 may 

25 provide enough information for the technician to perform 
the method abstracted therein. If the method helps the 
technician or user, such individual will activate a user 
feedback button next to the particular abstract shown in 
window 302. The application will then append the search 

30 text 301 to the relevance feedback file 602 which gave rise 
to this successful search associated with the diagnostic 
method file 302 pointed to by the abstract 306. 
In yet a second case, the diagnostic method abstract 302 

35 may appear useful or interesting to the technician or user 
viewing the method 306. If the method helps, the technician 
or user would activate the feedback button on the viewer. 
The application will then append the search text 301 to the 
relevance file 602 associated with the diagnostic method file 

^ 306 being currently viewed. 

In case 3, the diagnostic method abstract 302 again may 
appear interesting to the technician or user who is viewing 
the method 306. The method preferably will contain a 
hyperlink to another method. This third method will assist 

45 the technician or user, such that he or she will then activate 
an appropriate button on the viewer of the user interface. The 
application will then append the search text 301 to the 
relevance feedback file 602 associated with the diagnostic 
method file being viewed. 

50 Turning now to FIG. 7. a flow diagram is illustrated 
therein which may be implemented in program code and 
executed on the system of FIG. 1 for effecting the invention. 
First, after obtaining information about the problem domain, 
an initial build is made of statistical databases using 

55 symptom-diagnostic method objects. 652. Once this has 
been done, the system may begin to be used whereby 
through continued such use and the relevance feedback 
feature, the system improves over time. 
In use. user input is received. 654. of a problem or 

60 symptom in the problem domain as well as search strategy 
and arguments. Database searches are then run, 656. against 
the previously built PSI methods and defects databases. 658. 
676, respectively. As a result of such searches, a PSI 
diagnostics methods window (302 of FIG. 3) is displayed 

65 with hierarchically PSI methods abstracts as a function of 
the search/arguments, shown at step 660. The user will then 
interact with this graphical user interface display, providing 
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user input selection of specific displayed PSI methods as 
desired to be selected from the window generated in step 
660 — this step being shown at block 662. In response to 
such user input, display will be effected of the details of a 
specific selected method, 664. such as the specific PSI 5 
method view window 306 of FIG. 3. which includes details 
of the selected method to be attempted in order to diagnose 
the problem. The system then queries from the user whether 
another method view such as that of 306 of FIG. 3 is desired* 
in which case the system loops back to block 662 for the user 1Q 
to select another perhaps more appropriate PSI method for 
viewing. Once all such desired methods have been viewed, 
666. the system queries at block 668 as to whether the user 
desires more specific "how to" input (such as that shown in 
the window 308 of FIG. 3). If user response indicates this is 15 
desired, the specific "how to*s" details regarding 
configuration, installation, etc.. will be shown. 

In response to these displayed methods and how to 
information, the user is then expected to implement specifi- 
cally selected methods of diagnosis and will record the 20 
relative success of such methods. 672. A key feature of the 
invention it will be recalled is relevance feedback wherein 
the databases are improved as a result of this user action. 
Thus, as shown at block 674. the PSI methods and defects 
databases will then be modified and periodically rebuilt as a ^ 
function of this user-recorded result information. Search 
arguments will be appended using correlation of the specific 
PSI methods implemented or defects fixed and recorded 
results generated from the prior step 672. The arrows exiting 
block 674 to the PSI methods database and defects database ^ 
658, 676. respectively, are intended to reflect this modifi- 
cation and rebuilding of the databases. 

It will be recalled that notwithstanding the foregoing 
system and method description, a user may nevertheless also 
more conventionally desire display of defects and abstracts. 35 
Accordingly, in response to the user input at block 654 and 
the resulting execution of the database search against the 
defects database in response to the user-input search strategy 
and arguments, a display defect abstracts hierarchy 678 will 
preferably also be shown (such as that shown in window 304 40 
of FIG. 3). In similar manner to the display of the PSI 
diagnostic methods in response to the database search, user 
input is then solicited through the user interface for selection 
of specific defect views as desired, 680. This, in turn, will 
result in display of details of specific selected defects, such 45 
as that shown in the defect window 310 of FIG. 3. The 
system will query whether another defect view is desired. 
684. in which case, if the response is affirmative, the system 
loops back to block 680 to solicit user input selection of 
another specific defect. If no further defect views are 50 
desired, the system exits to block 672 whereupon the user 
may again attempt implementation of defect correction as a 
result of viewing the defect abstracts and views. The user 
will then record die results, as shown in block 672, and the 
process continues wherein the PSI methods and defects 55 
databases will be further improved as a result of recording 
of these results from viewing defects. 

While the invention has been shown and described with 
reference to particular embodiments thereof, it will be 
understood by those skilled in the art that the foregoing and 60 
other changes in form and detail may be made therein 
without departing from the spirit and scope of the invention. 

I claim: 

1. A method for providing support for problem resolution 
in a computer system, comprising: 65 
building a problem solution identification (PSI) database 
of diagnostic methods; 
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receiving a user-defined definition of said problem asso- 
ciated with said computer system; 

searching said database with a semantic distance search in 
response to said received definition; 

generating a plurality of hierarchically-ranked diagnostic 
methods identifying prospective sources of said prob- 
lem in response to said searching; 

executing one of said diagnostic methods; 

recording the result of said executing one of said diag- 
nostic methods comprising the steps of 
compiling a relevance feedback file having search texts 
appended thereto corresponding to different ones of 
said methods; 

periodically appending said relevance feedback file to 
said database; 

statistically analyzing said appended relevance feed- 
back file to generate statistical indexes for weighting 
said methods; 

altering said database with relevance feedback from said 
user as a function of said recording; and wherein said 
searching is performed with said statistical indexes. 

2. The method of claim 1 wherein said user-defined 
problem definition comprises at least one search argument 

3. The method of claim 2 further including 
displaying user-selectable abstracts of said hierarchically 

ranked diagnostic methods in a graphic user interface 
window of said computer system, 

4. The method of claim 3 further including 
detecting user input from said window designating one of 

said abstracts; and 
displaying in response to said detecting a problem source 
identification method view corresponding to said des- 
ignated one of said abstracts. 

5. The method of claim 4 wherein said abstracts are 
displayed in an order corresponding to said hierarchical 
ranking of said diagnostic methods. 

6. The method of claim 5 wherein each of said abstracts 
has a different said problem source identification method 
view associated therewith, each said view including descrip- 
tive text; and 

wherein said order of said abstracts in said window is a 
function of said relevance feedback. 

7. The method of claim 6 wherein said order of said 
abstracts in said window is further a function of said text 

8. The method of claim 7 further including 
building a defect database; and 

generating a plurality of hierarchically ranked defect 
abstracts in response to said searching. 

9. The method of claim 8 further including 

altering said defect database with said relevance feedback 
from said user as a function of said recording. 

10. An apparatus for providing support for problem reso- 
lution in a computer system, comprising: 

means for building a problem solution identification (PSI) 
database of diagnostic methods; 

means for receiving a user-defined definition of said 
problem associated with said computer system; 

means for searching said database with a semantic dis- 
tance search in response to said received definition; 

means for generating a plurality of hierarchically-ranked 
diagnostic methods identifying prospective sources of 
said problem in response to said searching; 

means for executing one of said diagnostic methods; 

means for recording the result of said executing one of 
said diagnostic methods including 
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means for compiling a relevance feedback file having 
search texts appended thereto corresponding to dif- 
ferent ones of said methods; 

means for periodically appending said relevance feed- 
back file to said method database; 

means for statistically analyzing said appended rel- 
evance feedback file to generate statistical indexes 
for weighting said methods; 

means for altering said database with relevance feed- 
back from said user as a function of said recording. 

11. The apparatus of claim 10 wherein said user-defined 
problem definition comprises at least one search argument 

12. The apparatus of claim 11 further including 
means for displaying user-selectable abstracts of said 

hierarchically ranked diagnostic methods in a graphic 
user interface window of said computer system, 

13. The apparatus of claim 12 further including 
means for detecting user input from said window desig- 
nating one of said abstracts; and 

means for displaying in response to said detecting a 
problem source identification method view correspond- 
ing to said designated one of said abstracts. 

14. The apparatus of claim 13 wherein said abstracts are 
displayed in an order corresponding to said hierarchical 
ranking of said diagnostic methods. 

15. The apparatus of claim 14 wherein each of said 
abstracts has a different said problem source identification 
method view associated therewith, each said view including 
descriptive text; and 

wherein said order of said abstracts in said window is a 
function of said relevance feedback. 

16. The apparatus of claim 15 wherein said order of said 
abstracts in said window is further a function of said text. 

17. Hie apparatus of claim 16 further including 
means for building a defect database; and 

means for generating a plurality of hierarchically ranked 
defect abstracts in response to said searching. 

18. The apparatus of claim 17 further including 
means for altering said defect database with said rel- 
evance feedback from said user as a function of said 
recording. 

19. A computer program product for providing support for 
problem resolution in a computer system* comprising: 

a computer usable medium having computer readable 
program code means embodied in said medium, said 
program code means comprising: 
computer readable program code means for building a 

problem solution identification (FSI) database of 

diagnostic methods; 
computer readable program code means for receiving a 

user-defined definition of said problem associated 

with said computer system; 
computer readable program code means for searching 

said database with a semantic distance search in 

response to said received definition; 
computer readable program code means for generating 

a plurality of hierarchically-ranked diagnostic meth- 
ods identifying prospective sources of said problem 

in response to said searching; 
computer readable program code means for executing 

one of said diagnostic methods; 
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computer readable program code means for recording 
the result of said executing one of said diagnostic 
methods including 

computer readable program code means for compil- 
5 ing a relevance feedback file having search texts 

appended thereto corresponding to different ones 
of said methods; 
computer readable program code means for periodi- 
cally appending said relevance feedback file to 
10 said method database; 

computer readable program code means for statisti- 
cally analyzing said appended relevance feedback 
file to generate statistical indexes for weighting 
said methods; 

15 computer readable program code means for altering 

said database with relevance feedback from said 
user as a function of said recording. 

20. The computer program product of claim 19 wherein 
said user-defined problem definition comprises at least one 

20 search argument 

21. The computer program product of claim 20 further 
including 

computer readable program code means for displaying 
user-selectable abstracts of said hierarchically ranked 
25 diagnostic methods in a graphic user interface window 
of said computer system. 

22. The computer program product of claim 21 further 
including 

M computer readable program code means for detecting u ser 
input from said window designating one of said 
abstracts; and 

computer readable program code means for displaying in 
response to said detecting a problem source identifica- 
35 tion method view corresponding to said designated one 
of said abstracts. 

23. The computer program product of claim 22 wherein 
said abstracts are displayed in an order corresponding to said 
hierarchical ranking of said diagnostic methods. 

40 24. The computer program product of claim 23 wherein 
each of said abstracts has a different said problem source 
identification method view associated therewith, each said 
view including descriptive text; and 

wherein said order of said abstracts in said window is a 

45 function of said relevance feedback. 

25. The computer program product of claim 24 wherein 
said order of said abstracts in said window is further a 
function of said text 

26. The computer program product of claim 25 further 
so including 

computer readable program code means for building a 

defect database; and 
computer readable program code means for generating a 

plurality of hierarchically ranked defect abstracts in 
55 response to said searching. 

27. The computer program product of claim 26 further 
including 

computer readable program code means for altering said 
^ defect database with said relevance feedback from said 
user as a function of said recording. 

***** 
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